POCOMEHT B9S0HE, 



ED 126 921 

AOTHOB 
OJITLE 
lOB DATE 
NOTE 



IB 003 836 



EDBS PBICE 
DESGEIP?OBS 



ABSTRACT 



Bilkinfiipn, Gene I. ^ 

EconoBic E~!t^luation of CAI in Special Education. 
Jul 76 , ^ 

22p. ; Paper presented at the International .Learning 
Technology 'Congress a^d Exposition ojx Applied 
^Learning Technology for Human Eesource Development 
(Washington/ B.C., Jaly 21-23, 19.76) 

■mP-$0.83 ec-$1.67 Plus Postage. \ 
Accounting; Budgeting; ♦Computer Assisted 
Instruction; *Cost Effectiveness; Costs'; Educational 
Technology; Estimated Costs; *Evaluation Methods; 
Program Evaluation; Research Methodology^ 



This is an introductory presentation of economic 
evaluation methods for assessing computer- assisted .instruction (CAI) 
Six different costing techniques, including cost effectiveness, are 
rev»i^wed^ost effectiveness is, theji. examined in terms of its 
usef ulne^tfor evaluating CAI. A simplified system for" cost/ 
effectivd^fcs eval-uation is presented which involves determination of 
objectives, alternatives, and costs, as well as interprktation of 
results. (CHJ ^ 




* .-Documents acquired by ERIC include many informal unpublished ♦ 

* materials not available from other sources. ERIC aakes every effort * 

* to obtain the best copy .available.- Nevertheless, items of marginal ♦ 

* :teprioducibility are often encouAtered a[nd this affects the' quality ** 

* of th6 -microfiche and hardcopy reproductions ERIC makes Available ♦ 

* via the e6iQ Document Reproduction Service (EDRS) . EDRS is not * 

* re^^ponsible for the quality of the original document. Reproductions ♦ 

* subplied^ by EDRS are the best that -can be made fxcm the original, ♦ 



ECONOMIC EVALUATION OF CAI IN SPECIAL EDUCATION 



Dr. Gene L. Wilkinson 
Assistant Professor of Educational Media 
University of Georgia 
Athens 3 Georgia 



U$ OE^AHTMENTO^WEALTH. 
EDUCATION 4 WELFAIte 
NATIONAL INSTITUTE OF 
EDUCATION 

THIS DOCUMENT MAS BEEN REPRO- 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIGIN- 
ATING IT POINTS OF VIEW OR OPINIONS 
STATED DO NOT h*ECESSARiLV' REPRE- 
SENT OFFlCrAL NATIONAL INSTtTuTE OF 
EDUCATION POSITION OR POLICY 



1 : . ■ 

Paper prepar'ed for delivery at thp FIRST kNTERNATIONAL LEARNING 
TECHNOLOGY 'CONGRESS AND EXPOSWION sponsored by the Society for 
Applied Learning Technolbgy, July 22-24, 1976, Washington, D.C' 



ERIC 



, "INTRODUCTION 

We have been invited here today to discuss several aspect; /'of the cost 
and effectiveness of employing computer-assisted instruction (:AI) in the 
area of special education. This is an important area for discjssion. Few 
would dgny that the expenditure of large amounts of resources needs to be 
based on economic as well as pedagological arguments— that schools must be 
productive and accountable to the agents fo society that fund {them. However, 
a number of individuals who have worked with the development of CAI have 
indicated a doubt that it will ever be "cost-effective" but fthitx we should 



go ahead, at least in some instances, with CAI development for 



J; 

noft-economic 



reasons CTorr, 1976; Oettinger, 1969)/ Others have argued thai cost-effec- 
tiv^ne ^s ana lysis strategies can not be applied until after th4 systems to be 
studies are operational (Seidel, 1969). Part oV the problem tha^ is encount- 
ered in the application of economic evaluation strategies to irmovative in 



structfoq4l techniques such as C'AI is a confusion over terminol 



of questions need to be answered before there can be any agreement on the 



ogy. A number 



appropriateness or usefulness of cost evaluation strategies in 
applicatioQ: , \^ y ' ^ ' 

(1^ What are cost-effectiveness and. cost-benefit analysis 

differ from other cost evaluation strategies? 
(2) Exactly what are the alternatives to be compared? Are 
viable? ' ' ' * 



any particular 



and how do they 



they ecfUally 



(3) Is cost-effectiveness an appropriate decision tool when the-de- 
$ired objective is non-quantifiable (such as an affective out- 
dome)? 

1 ^ 

(4) At what point in time during the development of an innovative in- 
structional approach is it appropriate to employ cost-effective- 
nbss and/or cost-benefit "evaluation strategies? 

In this paper, in order to address these and other questions which need 
to be consiWed in the application of cost evaluation strategies, t will (A) 

j 

define— and distinguish between— a number of different costing ^chniques\ 
(B) presentj a simplified system tor cost-effectiveness evaluation, and (C) 
apply cost-feffectiveness evaluation strategies to the problem of using com- 
puter-assisjed induction in the area of special ^ucationv 



DEFINITION OF COSTING' TERl<IINOLOGY 



There is a large number of different costing techniques and procedures 
which have bepn used interchangeably in the past. This lack of discrimina- 
tion has produced a high degree of confusion. In order to reduce the con- 
fusion a classification system for costing terminology has been proposed by 
the author (Wi|lkinson, 1971, T972). The basic elements of this system are 



outlined in Figure l"(on following page). • . 

The techniques are first classified into one of three groups on the 
basis of purpos;^ of the study: Descriptive, Predictive, or Comparative. They 

i ' ' ' 

are then further? divided within thes'e three categorieS^on the basis of the 
type of activities conducted under the technique.' 
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FIGURE ONE: 
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Descrtpti ve ; 



X 



Descriptive stadies seek to describq^ actual , existing, aii--gauig programs, 



The constitute the essential data base upor^ieh a.!! other costing studies 
are are^uilt/ Within thjs category, a distention is made between tyaditioaal 
(fiduciary) budgeting and those techniques which seek to relate costs to pro- 
gram objectives and outputs; . ^ ,^ ' 

- Traditional Budgeti rig— involves ihe establishment of expense Categories 
(such as personnel, supplies, equipment, etc^H the a^^propriation of resources 

and the authorization of expenditures by organiza- 
aid management in the control and reporting of the > 



to organizational units, 
tional units in order to 



resource inputs of programs. ' 

Cost Accountinq- j-irivolves the accurate measurement of output duality (stu- 



' dent achievement ) and/or quantity (number of graduates) at e(ch stage of the ' 
educational process and the assignment'of costs incurred to achieve thaf out- 
put~to ea/ch stage in orde^ toaid in managerial decisions, pertaining jo the 
allocation o^ resources to" maintain established production criteria. 

'Predictive • ' ' , 

The predictive group inckdes studies wliich seek to establish costs for 
•proposed systems. They involve the accurate definitiptr of ^objectives, the - 
definition of strategies to obtain objecti ves .tMdetermi nation of resources 
required to mount the strategies aad thejet^m/ersion "of determined resources 
to dollar amounts iti order to aid mjn^ement in the establishment of budgets 
and information systems. The raa^r sub-categories are: 

Cost Analysis— involy^ the analytical determination, of the. resources 
require to mount apr^efihed strategy at a set l£vel of/effgctiveness. 

Cost-Es tWti nq— involves the^application of statistical techniques to 
descriptfve data to predict a range of costs and effectiveness for a given 
strategy. 

- Comparative ' ' ' V 

The comparat^e studies are .based upon predictive studies whicn in turn 
-^are based upon destri^t^s^tudies. (The major distinctions are between thoH 
Studies which seek to compare the relative, costs and effectiveness of different 

strategies for obtaining a particular objective 91- set of objectives and those ' 

\ ■ - ■ 

• which seek to compare the "good" derived from the achievement of an objective ' 
wi^ the/'cost" to Society af seeking to achieve the objective. These ar?; « 
( Cos t-Ef f ecti veness Analysis^ -Tn^ol.ves the comparison of the resources re- 



\ 
-i 



quired (predicted costs) for, and the output of, feasible alternative stra- 
tegies for the achievement of program objectives in order to aid m^gement 
in the selection of the better strategy for either t'he achievement of, 
most production at a set cost or the achievement o/a, set level o^ produc- 
tion for the least cost under differing conditions. ' 

^ Cost- Benefit Analysis— involves the comparison of all the relevant re- 
sources (such as dollar value of personnel, equipment, etc.) required to 
achieve an objective with the likely benefits (dollar value of results) to 
be oWfained from achievement' of ' the objective in order to aid io, managerial, 
decisions as to the desirability of initiating or continuing a program in 
light of long-,railge tim^ and social consideratiorrs . ^ ^ 

The types of studies which need to be made of various applications of ' 
instructional technology, including. CAI, .are those 'on the cost-effectiveness 

and cost-benefit end of the scale. However, thes'e" are i?ased upon predictive 

.... / \ 

and descriptjAte_studies and herein lies the problem that\^causes a number of 

experts to say that the time is not ripe 'for/cost-effectiveness studies, of 
CAI. There is no adaquate' descri^ptive data base from which to ,make predic- 
tions or comparisons (Schramm, 1973; Jamison, 1974). There ha's be'en a pro- 
liferation of literature on the cost-effectiveness of technology. Caffarella 
(1975) was able to identify 429 references on the cost-effectivenesT^of in- 
structional technology. However, of the 3,00 that he was able to locate, only 
'32 were supported .by, emperical or quantitative -data. This is the sort of. 

problem that -the study reported on by Dr. Segal seeks to solve. 
W 

Even without an adequate data base, we intuitively use cost" evaluation 
strateg.ies to mal^ instructional decisions. ,>Je feel that, as expensive as 



;CAI isy it is better to develop such c^n appro^e^ than to do -nothing to at- 
tempt to improve school retention or to enhance individual student achiev- 
ment. When we do this,- we aremaking a cost-benefit evaluation. There is 
a large literature on the. economic return to fnvestment in education which 
helps to justify this sort of decision (Woodhall ,,^967,; Scanlon, 1973; 

f \ 

Rodrigues, .1974). Based on 1973 figures, the differente in median yearly 
incoiiie for thos>e who have completed high schoeVand those wlio hyive only com- 
pleted the first 8 years is $3,089. SpVead over 47 years of productive life 
(18-65) this represents an increase of taxable income of $1*45,283. Even a 
small reduction of the Over-all drop-oat rate as a result of implementing CAI 
might go a long way toward justifying the expense, even wi;:hout-a "ccmcurrent 
retlu«tion or re^ieployment of current educational resource. * When we consid- 
er the target population that we are concerned with in this session, the gain 
is even more striking. Those students who fall within special education pro- 
grams are, unless the educational system is able to assfst them in over- 
coming their handicaps, nouch more likely to be a drain on society's resources 
than a^ productive member of society. If just one person were^emoved from 
the wel^^are role and placid on thevt^tx^,i:ele^ a result of CAI, there would 
be a sigh^ificant gain to society. 

The sort of analysis^ that I hav^ been discussing needs to" be done with 
considerableniore rigor to be val^id. Such concepts as , discounting investment 
cost over time >ieed to be included. But,. even if it is done with all, the , ' 
economic rigor possible, it \vill primarily be able to tell us if something, 
should be done for a prC|blem area and give us the broad financial limits 
within which we may oper^ate. It will not tell us if CAI isjhe "best" solu- 

\ 8 



tion or what form of CAI should be used. For this sort' of decision, costr 
effectiveness analysis must -be employed. And, it is to this form of decisi^fi 



i 



making that I now turn,/ 

/ ' ■ 

COST-EFFECTIVENESS 'ANALYSIS 

The central pur^pose of cost-effectjveness, analysis is the evaluation of, 
and choice between, alternative means to acJhieve a given objective. The 
analysis can proceed frj^m either of two orientatiofis— the achievement of the 
most output for a set dollar cost or the achievement of the least dollar cost 
for a set level of output. No matter which of these approaches is employed, 
there^ar^ certa^in fundamental operations which need to-be carried out: 

(1) Determination of Objectives 

(2) Determination of Viable Alternatives ^ . ' ^ 

(3) Determination of Relevant Costs 

(4) Presentation and Interpretation of Results. ' , ' 

It will not be pqssible for me to go into detail on the techniques and pro- 
*cedures which are |ppropriate at each of these stages of the cost-efff ctive- 
ness evaluation process in this presentation. 1 would, however, like to hit 
a few of the high pornts and examine some of the questions which are of pri- 
.nWy concern to the topic under consfideration* . 

Determination of Objectives y \ 

The statement of objectives should include the .following: (1) the out 
puts to be obtained from the system, (2) the inputs available to the system, 
•and (3) -the units by which output and input are to be measured* The state- 
ment of objectives would not include information about presentation require- 

! ' ■ • . . 9 • . / 
/■ - • "' • • ' >* 
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ments and strategies (s^ch as, CAI'win be evaluated). Such.-aspects are 
not objectives to be met. They are constraints which limit the options 
Vrftich are available an^ help to establish the viable aTternatives to be 
evaluated. ' • ^ . , ' * - ■ 

A number of different measures^ave been proposed, and used, in-cost- 
effectiveness evalcrations. Gne common measure has been performance on • 
standardized achievement tests. The problem^here is that such tests^ are . 
designed to eliminate, or at least ^ninimize, the effects of different 

« * 

tea6hing' strategies. A betteV form of measurement might be criteriorl^f- 
erenced testing.- Other studies have used sucji economic indicators as stu- 
dent-contact-hours, graduates, or student-credit-hours. 

Two of the papers presented earlier irt this:session serve as good ex- ' 
amples of the two basic types of outpu-t measures. Dr. Cartwright presents ' 
a basically economic approach— dollar' cost^per student credit hour— while 
Dr. -Segal- is conce(7ned with' marginal annual costs per aghievement gain per 
child.. Other examples 9f. CAI cost-effectiv^ndss output maasures can be » * * 
located by .consulting some of the supplementacy- refe/ences which have been 
attached to this paper. " / ' • » 

<i One problem with objectives, whidh was alluded to in the questions -at 
the start of this paper, is that of using cost-effectiveness to evaluate non- 
quantifiable objectives, I think that the'answer would havfr to be yes and no. 
If you were able to identify a number of different strategies which were equals 
ly good at achieving the desired objective— a fixed effectiveness approach— 
you could use' this ev^jluation techn/que to chose between them. HoweVer, if, as 
is more often the case, the achi^ement might vary -as a result of changing 
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the resource mix, it wonjd no t be an appropriate tool. For this reason cost- 
effectiveness is often referred to as a deci-si on-assisting tool rather than-a 



decision-making tooT., Often such 



iantifiable out-comes. will cause the 

i 



Cision maker to chose the less^econcjHfical alternative. However, 'th'e reasons 
such a choice need to be cWrly spel led out, and the time to do thisMs^ 
ft • 

.duriijg the statement, of the objectives. 
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Determination of Viable Alternatives i ^ ' 

The secpnd stea of a cost-effectiveness analysis Is to determine the al- 
terna^tive instructional procedures^ media, .etc.;, to be compared. Initially you 
would want^toitart with the tot^l universe of possible strategies— limited only' 
by your>magi nation. In practical si tuations,^this ^n»iverse of possibilities Js 
very rapidly filtered dov/n by a consideration^of ^those practical 'constraints 
which serve to^limit our option$jj|^> we are dealing with real-World problems. 
The following figire illustrates how such a consideration of constraints can re- 
duce the total poSpulation of alternatives to just three viable alternates. 



FIGURE TWO: 
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in many cases,' ofte of the constraints under yhich .we operate' is the prior. • 
choice of one of .the media alternatives to evaluated^-for example , OAhHow^ 
eve?*, ^to_^say that CAI is to be one of the- alternatives is not^noygtrT^I, is a 
•fairly broad term wh-ich ^an mean a large number of thvngs^-both in terms of the 
software that is to be displayed and' the'hardware configurations Upon whicli the. 
Software is to-be displayed. Brabyl et-al, (1975) h?ive .identified, 10 major vari- 
ations of computer based delivery systems— ranging fron"i a^'ba^ic definition of CAI 
as a form bf individualized thstruction. that employs, digital computer technology., 
' to manage, and display information to a student, accept stu'de^it responses., provide 
knowledge of results, ar^d select subsequent learning events, thrdugti variations of 
.the f^LATO IV and TiCCIT systems. Computer Managed Instruction, and variations of 
computer simulation and gaming configuratipns. If CAI, is to be one of the alter- 
natives, the form and format of the, configuration must be clearly specified. 

" The need tor a, clearly defjned CAI configuration is even more important when 
it comes to determining the alternatives against' wliiph it is to be compared. The 
comparison" is to'.be with "viable" alternatives. What are viable alternatives to' 
CAI? Jhis would be determined by both tH|^ objectives and the constraints under' 
which the project is operating,, If the program is primarily orje of' rote "drill 

and practice, an alternative could be a linear programmed tefxt or a simple work- 

*' 'M 
book. Apd, given the almost constant research results of no significant differ- 

*' , ' ' ' / . 

ence, CAI would probably be a poor choice from ^.^t-effectiveness p.om^^ view. 
However, if the cons tra.iiHs called for taking advantage 'of the f lajffbi 1 i ty , meifl- 
ory capacity, and' faist response capabilities of the compute^fn order* to provide 
individually shaped, corrected/reinforced programs whi^nake into consideration. 
the needs, knowledge, prejudices, etc.',*of each le^^r, clearly alternatives. 



other than^worVbooks n^ed'lo be con^ideredrMwadit'ibnal iostruction.-the self-'" 
contained classroom of one tfeacher, 20-35 students, and various textbooks, aids 
e'tc-does not provide this sort of^lexibiTity apd . therefore, should not be one 
of the alternatives considered (in spite of the fact that this is' the most^com- 
monly evaluated arterhative^to.CAl in existing studies). Possibly /".tutor, work- 
ing on a one-torone basis (provideti that this tut.or has 'thfsame grasplof the 
subject field a.nd the various wa^s in which ,it can be misunder^stood and mastered 
as the team of design and subject fieM specialists who developed the CAI pro- 
gram)would be able to provide such an. alternative. Another possible alternative 
would be a paper^nd pencil (or other.media), test, teach, ^and retest approach 
such as in Individually Prescribed Instruction programs. * ' v 

Other^ than to point out that there was no apparent»attempt to ideAiff^and 
.evaluate viable alternatives in a conscious and rigorous manner, thereis 
" rveed to comment on the example studies which, have been presented here today .j 

Detentitnation of Relevant Costs " • • ' ^ ' 

Once the strategies to be- considered have been identified, the next/tep is 
tb^^ablish the relative cost and productivity of each strategy. Basically, 
two techniques can beemployed to determine these values. One applies cost analy- 
sis while thV^ther es-tablishes cost-estimating-relationships. 

Cost analysis" can proceed from one^of two approaches: fixed-effecti veness or 
fixed-cost. For the fixed-effectiveness approach, a target level of effectiveness 
is established. Theru systems are defined which would employ one of the alterna- 
tives lender cons idi^-at ion and pVo^uce at the set level of effectiveness. . The re- 
sources (such as personnel , equi pment," etc. ) which would" be needed to develop and 
maintain the systems are then determined and these resources Converted to dollar 



costs at the market price level, producing a tDtal dollar cost for each^al- 
ternative. The problem of -choice then beqomes one of selectfng^the least 
: expensive alternative. The other cost analysis approach starts from a fixed- 
cost basis.jjThis approach requires the analyst to determine the productivity 
of differ^t systems, each of which employes one of the strategies being con- 
sidered, wKl>ch <:ould be developed for a set level of funding. The problem of 
choice under this approach is ta sefect the most productive alternative. 

The determination of "the cost estimate through xpst analysis can become 
a highly complex cost accounting task, particularly if such concepts as sunk 
cost, inheritable assests, and discounting are applicable in the situation. 
Also, there is the difficulty of predicting the cost and the effectiveness of 
non-existant systems. The major problem- with cost analysis, however, is that ' 
the estimate produced is a single-point figure rather t^^^ continuous func- 
tion oyer variations in outp'ut and therefore requires a neji^s-tima^eloTe made 
if the projected funding level is notjuXfieiietftlyT^oductive to be economical. 

Cost-estimatjng rel^|<msTi1ps (CER) seek to avoid the major problem of • 
cost analysis^y establishing a continuous prediction function over a range of ' 
output levels. This is done by means of standard procedures of regression 
analysis appli&d'^o historical data from systems similar to the alternative under 
consideration^ As illustrated in the following figure, existing data'on the cost 
and productivity "of similar systems are plotted on a scattergram and the line of 
best fit is determined. Assuming that the assumptions necessary to emplo/ re- 
gression analysis have been met, the line of best ftt produces a continuous pre- 
dieted value of input or system co^t over the range of possible system output: 



FIGURE THREE; 
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There are a number of proWems associated with, the use of cost-estiniat- 
i'ng relationships. Often, for example, the line of bes.t fit whith can be de- 
rived from' historical data is turved leather than str'aight.x^And in a strategy, 
such as CAI, which has a large capital investment for implementation (central 
memories, terminals, processors, etc.) each segment of "which has an ultimate 
capacity, the CER is more likely to take the form of stair steps with sloping 
platforms. Other difficulties arise from W data base fnom whic.h .the esti-' ' 
-mates are derived. The information may be in the wrong format .(requiring ex-, 
amination of the detailed cost figures as well as' total systeii| cost) and very 
likely the data were generated at different times (requiring at least adjust- 
ment for inflation or othe^- changes in the market value of) resources). Such 
problems greatly increase the difficulties encountered by the analyst and af- 
feet theVe^i ability of th6 values generated through the use of CERs. This' 
can be seen irt Figure Four (on the following page) wheKe confide'nce intervals 
have been plotted on the CER generated from the un-adjusted data shown above. 



FIGURE FOUR 
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■ Such high levels of yncertainty can malce the decision, makers job one of 

acting on intuition rather than acting on soqie rStiona-1 economic basis. 

\ • , 

Presentation and Interpretation of Results " , 

With the establishment-UTthe estimated costs for tfrn^ various alternati>/es 
under consi.da;^n; the final task is to present the data inVformat th< 
wilTam the decision maker in arriving at his conclusions/f If the^iqsl analy- 
sis prea^iction technique- has been employed, the task is i^latively sini"p^-^ra 
one" page summary. of the results w^ld be more th.an ade/(uate. Detailed projec\ 
tions are not nedessary at this .point although they shbuld be kept, ready -foV 
budget preparation. A balance sheet approach , 'however,, \is not feasible^f \C£Rs 
were employed, because the continuous i^ature of the projechxjn cannot be read- 
ily conveyed by raw figures. With projections derived from cost^stimating re- 
lationships a graphic decision modet should be employed, such as th\"one shown 
in Figure Five on the. following page. 

By plotting the CERs of each of the. strategies to be considerea-on^a^^siTi"- 
gle matrix, it is possible to determine an envelope of optimum choice (shown as 

' 16 



FIGURE fIVE: 
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, a dotted Irne,) "which identifies the "best" choice of strUegies fgr any level 

' of desired output or any- level of available funding. - - ' 1 

1 

Although the cost-effectiveness approach to decision making seemk to 
litoit the freedom of the decision maker, ^ch is not -lTeeessar-i4^-JJifi..£ase. 



Using' the example above,' a system may planned to start with axapacity of 



over al- 1% 



250 students but, eventually to expand Ao 50Q studer>ts. In such a-situation 
ttie decision maker-, might .well choose^ the moke expensive alternative B 
ternative A for the initi.al .system so that in the long riin he would be benefit-! 
ing. from the' more economical aWernative. Also,, since there is a cer^tain de- 



gree of uncertainty 'associated with the derived estimates due to unreliability 
..of the data base, the decision maker's personal preferences may stiljl enter in- 
to the decision process, ih'e only requirement "would be that he justify on some 
^ .valid basis/the choice of a less' -Obviously econon\ical alternative*.' * 

The distinction between cost-effectiveness and >fcost-benefit analysis -can 
be illustrated by" converting the cost-effectiveness decision model presented 
abOjVe to -a jGOst.-ber/efit decision The converstion is produced by esti- , 



mating the value of benefits to be obtained from the institution of any one 
of the altfernatives at any level of output. Once this value has been deter- 
mined, the cost of producing the output is subtracted from the value to be 
obtained from employing th§ strategy at that level of production and the de- 
cision matrix -is redrawn as in the following figure. The base line of stu- 



FI6URE SIX: 
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dent.xiapacity is now at ^the midpoint of the model, with positive >/orth of the 

systems above the line and negative worth below*the lin*e. It.ls now possible 

, ' •• ^ . / ' 

to see that for each of the alternatives there is a negative worth to society 

for some level of productivity or output. At' some point of output, the best 



choice is to do nothing, 



ANSLYSIS Oj^ RRESENTATIONS 



< With a context provided, it now possible to look at and analyze the other 
papers presented -in this session. On the surface none of them are cost-effec- 
tiveness studies in the way that I have defined such stu'dies. The closes-t is 

. 18/ , 



the ETS proje/t reported on by^Dr. SegSI. Hpwever, it more closdly repre- 
sents a cas^ of cost accounting. The '^Rur|)ose of the study is to produce the 
data base/for generating a CER for CAI, and therefore is essential to the 
generation of cost-effectiveness studies in the future. There ik a great 
need f<5r such an emperical ly^established data base for CAI— and Ifor other 
forms/of mediated instruction— so that such studied can be condjlcted. The' 
othe/- papers are both concerned wjth cost and with effe^ttv^es-fe but they do 
not/sh(;lw the analitical comparison of alternatives that is called for in the 



tern "/cost-effectiveness", 




\ 
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